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(54) Method and system for generating document summaries with navigation information 



(57) A method and a system for generating a docu- 
ment summary. The method and the system extract text 
along with corresponding position information from a 



document, provide the extracted text to a document 
summarizer (62) and generates a summary with indica- 
tors that indicate the corresponding locations in the doc- 
ument from which the summary portions were extracted. 
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D script ion 

[0001] This invention relates to a method and a sys- 
tem for automatic text processing. In particular, this in- 
vention relates to a method and system for generating s 
a document summary with document navigation infor- 
mation. 

[0002] Automatically generated document summa- 
ries serve a valuable function by reducing the time re- 
quired to review documents. Conventional summaries, 10 
while providing a good indication of the total content of 
the summarized document, do not provide any means 
for accessing the content of the document. Therefore, if 
a reader is particularly interested in a certain portion of 
the summary, the reader is forced to scan the text of the is 
entire document to locate the portions of the document 
that correspond to points of interest in the summary. 
There exists a need for assisting a reader in locating 
portions of a document that correspond to portions of 
the summary. 20 
[0003] In accordance with one aspect of the present 
invention, a method for summarizing a document com- 
prises: 

extracting text from the document along with corre- 2s 
sponding location information; 
identifying portions of the extracted text that reflect 
the content of the document; 

generating a presentation file that includes the iden- 
tified portions and a first set of indicators that indi- 30 
cate the locations of the corresponding extracted 
text in the document: and 
presenting the presentation file. 

[0004] Preferably, the method further comprises for- 35 
matting the layout of a presentation file that includes the 
identified portions and a first set of indicators that indi- 
cate the locations of the corresponding extracted text in 
the document 

[0005] In accordance with a second aspect of the 40 
present invention, an automatic document summarizer 
comprises: 

a processor that comprises: 

a text extractor that extracts text from a document 45 
along with corresponding extracted text location in- 
formation; 

a document summarizer that identifies portions of 
the extracted text that reflect the content of the doc- 
ument; and so 
a presentation file formatter that formats the layout 
of a presentation file that includes the identified por- 
tions and a first set of indicators that indicate the 
locations of the corresponding extracted text in the 
document; and ss 
a presentation system that presents the presenta- 
tion file. 



[0006] This invention generates a summary page that 
includes indicators that help the user find the corre- 
sponding place in the summarized document from 
which the summary information was extracted or to 
which the summary information is most related. This in- 
vention enables the user to navigate from the summary 
to the related locations in the document. This invention 
also highlights the portions of the document that have 
been extracted for the summary. 
[0007] This invention connects the summary informa- 
tion with the contents of the summarized document by 
adding location information and/or navigation informa- 
tion to the summary. The method and the system of this 
invention work with conventional image or text docu- 
ment summarization systems by preserving the location 
information of the content that is extracted from a doc- 
ument and by generating a summary with indicators that 
indicate the corresponding locations in the document 
from which each portion of the summary was extracted. 
In one embodiment, these indicators indicate page and 
line numbers and have matching indicators within the 
summarized document. 

[0008] This invention prepares a file from the docu- 
ment for input into a conventional document summariz- 
er, receives the output from the automatic document 
summarizer and conditions the output to provide indica- 
tors to the output summary and document. 
[0009] The indicators of this invention enable the user 
to quickly access the corresponding portions of the doc- 
ument that are related to the summary by directly ac- 
cessing the document using the information indicated 
by the indicator or by locating a matching indicator within 
the outputted document. This task is made easier by 
highlighting the extracted portions within the outputted 
document. 

[0010] This invention uses an automatic summarizer, 
linked to a device that can identify the page image and 
page location in the original document where the sum- 
mary material is located. The location information is 
generated by a conventional or modified text or image 
summarizer. In image summarization, a page number 
can be found by applying image matching methods. In 
the case of text summarization, conventional printing 
software can be modified such that the page numbers 
assigned by it are made known to the software imple- 
menting the present invention. 

[0011] The preferred embodiments of this invention 
will be described in detail, with reference to the following 
figures, wherein: 

Fig. 1 is a block diagram of one embodiment of the 

document summarizer of this invention; 

Figs. 2A-2B show a flowchart outlining the control 

routine of one embodiment of this invention; 

Fig. 3 is a block diagram of one embodiment of a 

processor of this invention. 

Fig. 4 is a sample summary generated by one em- 
bodiment of this invention; and 



> 093371 2A2_L> 



2 



s 1 




3 EP 0 933 712 A2 



Fig. 5 shows the source document that was ana- 
lyzed to produce the summary of Fig. 4. 

[0012] Fig. 1 shows a block diagram of one embodi- 
ment of the document summarizer 10 of this invention, s 
The document summarizer 10 includes a processor 12 
communicating with a memory 14 and a hard drive 16. 
The processor 12 also communicates through an input/ 
output interface 18 to any number of conventional input/ 
output devices such as a pen 20, a mouse 22, a key- io 
board 24,- a display 26, an optical character recognition 
system, a printer 30, and a scanner 32. The input/output 
devices 20-32 are operated by a user to control the op- 
eration of the document summarizer 10. The processor 
12 also communicates through link 34 to an external da- *s 
ta source 38. The link 34 includes an interruptible con- 
nection 36. 

[001 3] As shown in Fig. 1 , the system 1 0 is preferably 
implemented using a_programmed general purpose 
computer. However, the system can be implemented us- 20 
ing a special purpose computer, a programmed micro- 
processor or microcontroller and any necessary periph- 
eral integrated circuit elements, an ASIC or other inte- 
grated circuit, a hardwired electronic logic circuit such 
as a discrete element circuit, a programmable logic de- 2s 
vice such as a PLD, PLA, FPGA, or PAL, or the like. In 
general, any device on which a finite state machine ca- 
pable of implementing the flowcharts shown in Figs. 2 A 
and 2B can be used to implement the system 10. 
[0014] Additionally, as shown in Fig. 1, the memory 30 
14 is preferably implemented using static or dynamic 
RAM. However, the memory 14 can also be implement- 
ed using a floppy disk and disk drive, a writeable optical 
disk and disk drive, a hard drive, flash memory: or the 
like. Additionally, it should be appreciated that the mem- 35 
ory 14 can be a distinct portion of a single memory or 
physically distinct memories. 

[0015] Further, it should be appreciated that the link 
34 connecting the microprocessor 1 2 to the external da- 
ta source 38 can be a wired or a wireless link to a net- 40 
work (not shown). The network can be a local area net- 
work: a wide area network, an intranet, the Internet, or 
any other distributed processing and storage network. 
In this case, a document may be downloaded from an 
external data source 38 for processing by the system 45 
10 according to the method outlined below. 
[001 6] Figs. 2A and 2B show a flowchart outlining the 
control routine of one embodiment of the method of this 
invention. Beginning in step 1 00, the control routine con- 
tinues to step S110 where a document is input into the so 
system 10. In step S120, the control routine determines 
whether the document is summarizable. If the document 
is not summarizable, the control routine continues to 
step S1 30. In step S1 30, the control routine prints a "ge- 
neric" cover sheet and continues to step S1 40. The "ge- ss 
neric" cover sheet may include any type of information 
that may not be related to the input document. In step 
S140, the document is print d and the control routine 
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continues to step S1 50 wh re the control routine stops. 
[0017] If in step S120, the control routine determines 
that the document is summarizable, the control routine 
jumps to step S160. In step S140, the control routine 
determines if the document is of a special type that re- 
quires or may benefit from special processing. A docu- 
ment of a special type may be identified by a user. An 
example of a special type includes a group of e-mail 
messages that each have a summary field. This exam- 
ple will be explained in more detail below. 
[0018] If the document is in a special format, the con- 
trol routine continues to step S170. However, if the con- 
trol routine determines that the document is not in a spe- 
cial format, the control routine jumps to step S170. In 
step S150, the control routine extracts the summary in- 
formation in accordance with the special processing and 
jumps to step S270. 

[0019] In step S180, the control routine identifies the 
format of the document and continues to step S190. In 
step S1 90, the control routine generates a printable file 
from the input document. This printable file is necessary 
to generate layout information which will be used in sub- 
sequent steps. The control routine then continues to 
step S200 where the control routine extracts text from 
the printable file and creates another file that is suitable 
for processing by a summarizer. Then the control routine 
continues to step S21 0 where the control routine creates 
a layout file having position information on the printable 
file created in step S1 90 and corresponding pointers to 
the extracted text file created in step S200. The control 
routine then continues to step S220, where the control 
routine analyzes the extracted text file to determine 
which portions of text will be included in the summary. 
The control routine may use a conventional or modified 
text summarizer. The control routine then continues to 
step S230 where the control routine generates a print- 
able output file by concatenating the summary text in 
the printable file created in step S190. Preferably, the 
summary is placed in the output file before the original 
document in a cover page. The control routine then con- 
tinues to step S240. In step S240, the control routine 
modifies the output file by attaching indicators that indi- 
cate the location of the portions of the summary in the 
original document. The indicators are created by refer- 
ring to the extracted text file and to the layout file. The 
control routine then continues to step S250 where the 
output file is modified to place the indicators in the mar- 
gin of the cover page. The control routine then continues 
to step S260. 

[0020] In step S260, the control routine modifies the 
output file by adding additional indicators that are posi- 
tioned adjacent to the portions of the document that cor- 
respond to portions of the summary. The control routine 
also highlights the indicated portions of the document in 
step S260. The control routine then continues to step 
S270. In step S270, the control routine sends the output 
file to a printer to print the document and then continues 
to step S280 wher the control routine stops. 
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[0021] If the input document is identified as requiring 
special processing in step S160 then the control routine 
continues to step S1 70. In step S1 70, the control routine 
generates an output file that has a summary page with 
indicators that indicate from where each portion of the s 
summary originated in the input document. The inten- 
tion of steps S1 60 and S 1 70 are to make clear that one 
of ordinary skill in the art would know that steps 
S 1 80-S260 can be modified in accordance with the input 
document type and still form a part of the invention. 10 
[0022] One example of an input file that could benefit 
from special processing is a document that includes 
several e-mail messages that each have a "subject- 
field. The control routine recognizes that such a docu- 
ment requires or can benefit from special processing, is 
Alternatively, a user can identify the input document as 
requiring special processing to the control routine with 
a user interface (not shown). In this example, the 
processing would take advantage of the knowledge that 
there are predefined "subject" fields and will generate a 20 
summary from these "subject" fields and thereby obvi- 
ate the necessity of performing a text summarization 
process on the document. The summary would include 
the text from each "subject" field along with indicators 
that indicate the position in the output file where each 25 
portion of the summary may be found. 
[0023] A specific example of the operation of this in- 
vention will now be described while referring to the flow- 
charts of Figs. 2A and 2B. The source document in this 
example is a PostScript file. PostScript is a page-de- 30 
scription language from Adobe Systems, Inc. that offers 
flexible font capability and high-quality graphics. Post- 
Script uses English-like commands to control page lay- 
out and to load and scale outline fonts. A page descrip- 
tion language describes output to a printer or a display 3S 
device using instructions from the page-description lan- 
guage to construct text and graphics and to, thereby, 
create the required page image. 
[0024] Processing of the PostScript file starts at step 
S100 and continues to step S110 where the file is input 40 
to the system. The control routine continues to step 
S 1 20 where the control routine determines that the doc- 
ument is summarizable and then continues to step S 1 60 
where the control routine determines that the PostScript 
file is not one of a predetermined special type. 45 
[0025] The control routine continues to step S180 
where the format of the input document is identified as 
PostScript. The control routine continues to step 190 
where the control routine generates a printable output 
file. In this example, because the PostScript file is al- so 
ready printable, the control routine merely makes a copy 
of the input document as the printable output file. There- 
fore, the printable output file is also a PostScript file. The 
control routine then continues to step S200 where the 
text is extracted from the printable file. The control rou- ss 
tine continues to step S200 where the control routine 
extracts the text using a modified PostScript interpreter 
and a text extraction program. In step S200, the Post- 
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Script interpreter analyzes the PostScript file and gen- 
erates an ASCII file that includes position information. 
The invention then utilizes a text extraction program. 
The text extraction program maps font differences, an- 
alyzes the stream of characters, and picks out words, 
lines, and paragraphs. The text extraction program also 
records the location information in accordance with the 
identified, extracted text. The control routine then con- 
tinues to step S210. In step S210 the control routine 
generates a layout file and continues to step S220. 
[0026] In step S220, the system analyzes the ASCII 
file using text summarizer to determine what portions of 
the extracted text are to be included in the summary. 
The control routine then continues to step S230 where 
a PostScript generator creates a printable output file. In 
step S230, the output file is created using the summa- 
rized text from step S220 and the position information 
corresponding to the summarized text from the layout 
file created in step S210. The control routine then con- 
tinues to step S240. In step S240, the control routine 
modifies the output PostScript file with instructions that 
add indicators to the summary. The control routine then 
continues to step S250. In step S250, the control routine 
appends the output PostScript file with instructions that 
add indicators to the margin of the cover page. The con- 
trol routine then continues to step S260. 
[0027] In step S260, the control routine modifies the 
output PostScript file to highlight those portions of the 
document that correspond to the portions of the sum- 
mary. The control routine then continues to step S270 
where the control routine sends the output PostScript 
file to a printer and then continues to step S280 where 
the control routine stops. 

[0028] It should be appreciated that while the inven- 
tion has been described above in connection with Post- 
Script and ASCII text files that this invention may be 
used in conjunction with any type of document format 
including, for example, any type of graphic, audio, and 
video document formats. 

[0029] It should also be appreciated that steps S210, 
S220 and S240 are all optional and that the indicators 
may take whatever form is appropriate for the desired 
style of output. The indicators only need to provide a 
reference to the document content by providing position 
information or as an indicator to be matched with anoth- 
er indicator within the document. 
[0030] Additionally, while the embodiment of the con- 
trol routine described above and in Figs. 2A and 2B gen- 
erates a single output file, one of ordinary skill under- 
stands that the control routine may generate any 
number of output files such as, for example, a first output 
file having only the cover page with a summary and a 
second output file having only the document. 
[0031] Typical document summarizers pr sent the 
sentences in the summary in the same order that the 
sentences are encountered in the summarized docu- 
ment. However, these sentences may not be in the 
same order in the summary as they appear in the related 
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document. In that case, the indicators may be presented 
in the summary in the order that the summary presents 
the sentences or in the order in which the sentences ap- 
pear in the related document. If the indicators are to ap- 
pear on the summary page in the order that the sentenc- 5 
es appear in the related document, then leaders may be 
provided from the indicators to each of the correspond- 
ing portions of the summary. 

[0032] The output of the summarized document may 
not facilitate easy positbning of indicators to readily in- 
dicate which portions of the summarized document cor- 
respond to the indicator. Therefore, leaders may also be 
added from the indicators in the summarized document 
to the portions of the summarized document that have 
been extracted for the summary. 
[0033] The indicators may be placed on the summary 
page in a vertical position on the margin that corre- 
sponds to the vertical position of the corresponding por- 
tions of the summarized document. Such an arrange- 
ment makes it easier for a user to find an indicator within 
the summarized document when flipping through a doc- 
ument. Indicators in the summarized document may be 
eliminated very quickly when the vertical position does 
not match the vertical position of the indicator in the 
summary sheet. On the other hand, an indicator that has 
a vertical position that matches the vertical position of 
the corresponding indicator in the summary sheet can 
quickly indicate the correspondence between the two in- 
dicators to the user of the document. 
[0034] Additionally, this invention also provides indi- 
cators to a list of keywords. Conventional document cat- 
aloging systems generate a list of keywords that may 
be quickly searched to locate a document related to the 
keyword. This invention is also useful with a keyword 
list generating system to provide indicators adjacent the 
keywords to indicate the location of the keywords within 
the summarized document. 

[0035] The indicators may also take the form of a 
background color or font color on a portion of the docu- 
ment summary. In this case, a matching indicator in the 
summarized document is highlighted using a back- 
ground or font color that matches the corresponding por- 
tion of the summary. The indicators may also take the 
form of character attributes such as Bold or Italics. In 
this case, for example, a portion of the summary may 
be bold while another portion is italicized. The corre- 
spondence to the original document would be indicated 
because the source text would have a corresponding 
character attribute. It is to be understood that the indi- 
cators may take any form that allows one to distinguish 
between indicators and also indicates the correspond- 
ence of each portion of the summary to the source in 
the underlying original document. 

[0036] Fig. 3 shows a block diagram of one embodi- 
ment of the processor 12 of this invention. The proces- 
sor 12 is preferably implemented using a general pur- 
pose computer 50. The general purpose computer 50 
preferably includes a controller 52, a memory 54. a doc- 
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ument type identifier 56, a document interpr ter 58, a 
text extractor 60, a document summarizer 62, an output 
formatter 64, and a bus 66. The elements of the general 
purpose computer 50 are interconnected by the bus 66. 
The document type identifier 56, the document interpret- 
er 58, the text extractor 60, the document summarizer 
62, and the output formatter 64 are used to implement 
the flowchart of Figs. 2A and 2B. It should be appreci- 
ated that the document type identifier 56, the document 
interpreter 58, the text extractor 60, the document sum- 
marizer 62, and the output formatter 64 are preferably 
implemented as software routines running on the con- 
troller 52 and stored in the memory 54. It should also be 
appreciated that many other implementations of these 
elements will be apparent to those skilled in the art. 
[0037] It should be understood that the term "docu- 
ment" is intended to include text, audio, video, or any 
other information storing file in any combination of infor- 
mation storing files. Further, it should be understood that 
the term "text" is intended to include text, digital ink, au- 
dio, audio bars, video, or any other content of a docu- 
ment, including a document's structure. It should also 
be appreciated that the term "display" is intended to in- 
clude any type of presentation device appropriate for the 
type of text in the document. It should be further under- 
stood that the term "portion" is intended to include any 
divisible structure of a document such as, for example, 
words, sentences, phrases, paragraphs, sections, pag- 
es, and any other distinguishable portion of a document. 
Structural information designates divisible portions of 
documents. 

[0038] Fig. 4 shows a sample output of one embodi- 
ment of this invention. Fig. 5 shows the source docu- 
ment 70 which has been summarized. 
[0039] A summary sheet 72 includes a header 74 and 
a summary 76. The summary sheet 72 also includes the 
title of the summarized document 78 adjacent to an ex- 
tracted portion of the document 80 that generally reflects 
the overall content of the document. The summary 76 
includes extracted portions 82 which reflect the content 
of portions of the summarized document 70 and a list of 
keywords 88. Indicators 84 have been placed adjacent 
to the corresponding extracted portions 82. These indi- 
cators 84 have corresponding tabs 86 positioned on the 
margin of the summary sheet 72. The tabs 86 indicate 
the vertical position of the extracted portion in the sum- 
marized document 70 that correspond to the indicators 
84. In this example, the summarized document has not 
been output with indicators or tags that correspond to 
the indicators 84 and tags 86 of the summary sheet. It 
should be appreciated that other embodiments of this 
invention may provide indicators and tabs in the output 
of the summarized document 70. 
[0040] While the above explanation and description 
has generally referred to position and location informa- 
tion, it is to be understood that the indicators of this in- 
vention include valuable navigation information as a re- 
sult of the fact that the indicators include position infor- 
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mation. Therefore, the indicators include navigation in- 
formation which is helpful to a user to navigate a docu- 
ment to locate the position in a document from which a 
particular portion of summary originated. 



Claims 



a presentation file formatter that formats the 
layout of a presentation fil that includes the 
identified portions and a first set of indicators 
that indicate the locations of the corresponding 
extracted text in the document; and 
a presentation system that presents the pres- 
entation file. 



1 . A method for summarizing a document, the method 
comprising: 

extracting text from the document along with 
corresponding location information; 
identifying portions ol the extracted text that re- 
flect the content of the document; 
generating a presentation file that includes the 
identified portions and a first set of indicators 
that indicate the locations of the corresponding 
extracted text in the document; and 
presenting the presentation file. 

2. The method of claim 1 , where the location informa- 
tion comprises structural information. 

3. The method of claim 1 or claim 2, where the location 
information comprises layout information. 

4. The method of any of claims 1 to 3, further compris- 
ing the step of identifying the document as being of 
a predetermined type, wherein the steps of extract- 
ing and identifying correspond to the predetermined 
type. 

5. The method of any of claims 1 to 4, further compris- 
ing: 

generating a second set of indicators that cor- 
respond to the first set of indicators; and 
placing the second set of indicators in the lay- 
out of the document adjacent to the corre- 
sponding extracted text, wherein the first set of 
indicators comprise presenting each corre- 
sponding portion of summary in a presentation 
attribute that corresponds to the second set of 
indicators that comprise the presentation of the 
corresponding extracted text of the document 
in the same corresponding presentation at- 
tribute. 



7. The summarizer of claim 6, where the location in- 
fo formation comprises structural information. 

8. The summarizer of claim 6 or claim 7, where the 
location information comprises layout information. 

is 9. The summarizer of any of claims 6 to 8, wherein the 
processor further comprises a document type iden- 
tifier that identifies the document as being of a pre- 
determined type, wherein the text extractor extracts 
the text using a method corresponding to the iden- 

20 tified predetermined type and the document sum- 
marizer identifies portions using a method corre- 
sponding to the identified predetermined type. 

10. The summarizer of any of claims 6 to 9, where the 
25 presentation file formatter generates a second set 
of indicators that correspond to the first set of indi- 
cators and places the second set of indicators in the 
layout of the document adjacent to the correspond- 
ing extracted text, wherein the first set of indicators 
30 comprise presenting each corresponding portion of 
summary in a presentation attribute that corre- 
sponds to the second set of indicators that comprise 
the presentation of the corresponding extracted text 
of the document in the same corresponding pres- 
35 entation attribute. 



40 



45 



An automatic document summarizer comprising: 50 



a processor that comprises: 
a text extractor that extracts text from a docu- 
ment along with corresponding extracted t xt 
location information; 

a document summarizer that identifies portions 
of the extracted text that reflect the content of 
the document; and 
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Text Of Remarks By RXC Chairman Haley Barbour 
My name's Haley Barbour, and we are all part of the 
American family. 

9* 



*A We are the Republican Party - a big, broad, diverse and inclusive party.' 

witb a common-sense agenda and a better man for a belter America. 
ft4* Bob Dole. 



Thank you. ladies and gentlemen for being part of ibis quest in working 
£^ with us to restore the American Dream. 

What we're doing here this week is celebrating Republican ideas and 
achievements, the ideas and achievement* that represent the first step 
io our campaign to restore the American dream of more and better 
jobs: of smaller, smarter government; of stronger families and a return 



to traditional values. 



These common-wow Republican proposals are the first step in restoring 
g^j. toe American dream because Republicans care about America. 

^•E And under the leadership of President Bob Dole, we Republicans can and 
will restore the American Dream. 



KEYPHRASES 

• American dream 

• Haley Barbour 

• first step 

• Bob Dole 



e>3 



9o 



62. 



9fe 



6fo 



JSDOCID:<EP 0933712A2 I > 



11 



EP0 933 712 A2 



Text Of Remarks By RWC Chairman Haley Barbour 

Hy qam's Haley Barbour, and we axe all part of 
the American family. And we all believe we can 
rat cor* the American Dream. 

we ara the Republican Party — a bio. broad* 
diverse and inclusive parcy, with a common -sense 
agenda and a better nan for a bat tar America. 
Bob Do la. 

Thank you, ladiaa and gentlemen Cor being part 
of thii quest in working with us to restore the 
American Dream. 

I'd lika to welcome you delegatea and guests to 
cha 1996 Republican National Convention. What 
we're doing nere tlue weak la celebrating 
Republican ideas and achievements, tna idea* and 
achievements that raprasant the first step in 
our campaign to reatore tna American dree* of 
more and better jo bar of smaller, smarter 
government ; of acrongar families and a return to 
traditional values. 

Wa'ra her* to talk and to listen to our 
delegates and to Aaarica about the cosoon- sense 
proposal » that are right Cor our f ami lies. Cor 
our communities, and for our country. 

These common-sense Republican proposals ara the 
first itap in restoring the American dreaa 
because Republicans cars about America. 

we cart about working people. That's why we went 
than to earn more for their work and gat to keep 
more of what, they earn. 

we care about families, and that's why we want 
to cut their taxes and get government out of 
thsir livaa so they can make their own decisions 
abouc what's right for their children. 

we care about children. That's why we want to 
win the wax on drug* and not just run up the 
white flag. 

we care about people on welfare. That's why we 
went to gat thee off welfare and back on the 
road that leads the* to a batter life for 
themselves and for their kids. For the kids of 
welfare families are the pons of the liberal war 
on poverty. 

That's all part of restoring the Anerican Dream. 
And under the leadership of President Bob Dole-, 
we Republicans can and will restore the Amaxicaa 
Or ana. 
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